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A3STRM3T 

In this thesis a sequential detection scheme 
is proposed for a class of information transmission systems 
(ITS) in -which information regarding a particular message 
symbol is spread over several received symbols intervals. 

The channel for these ITSs is assumed to introduce additive 
white Gaussian noise (AWGW). Comriiunication sys-fcems employing 
convolutional encoding or having inter symbol interference 
as well as feedback communication systetisare cited as 
examples of such ITSs • ¥here a high error performance is desirec 
fixed decoding delay detectors are commonly employed. 

An interesting alternative considered here, is 
one in which a variable decoding delay is involved since 
only as many future received symbols (together with all 
the past received symbols) are examined as are necessary to make 
a decision regarding a message symbol -with a certain level 
of confidence* A sequential detection test (SDT) is 
employe^j in this detector in order to determine as to when 
a satisfactory decision regarding a particular message 
symbol can be made.' 

Two sequential detectors employing in their SDTs a 
probability ratio and a maximum likelihood criterion 
respectively are considered in this report. The detector I 
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employing a probalDility ratio for its SDT (the SDT is then referred 
to as the sequential probability ratio test SPRT) is showi 
to have an error performance comparable to that of the 
optimim fixed decoding delay receiver and hence a comparision 
between the two detectors is inadvS revealing the sequential 
detector to enooy a reduced computational complexity at 
the cost of a-' loss in decoding speed* However, both the 
detectors are in need of exponentiators for their implementation 
and hence an alternative sequential detector namely, the 
sequential detector employing a ML criterion is considered. 

This detector is shown to have an error performance comparable 
to that of the Viterbi detector and does away with the 
large survivor storage requirement of the Viterbi detector 
though it also suffers from a lower decoding speed. An 
extension of the generating function techniq.ue introduced 
by Viterbi is used to obtain bounds on the performance : 

of this detector and these bounds are then evaluated 
for the specific case of communication systems employing 
convolutional coding. Simulation results are also 
presented, to determine the tightness of these bounds as 
well as to examine other important features of the sequential 
detector such as the applicability of decision feedback 
as well as the buffer requirement acruing from a variable 
decoding delay. Finally, a few conclusions as to when sequential i 

<Jet®at3ai can be applied are drawn on the basis of the above fesulf 
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CHAPTER I 


INTRODUCTION 

1,1 The Topic of the Thesis and Related Work 

This thesis is com erned with an application 
of the principle of sequential detection to the prohlems of 
reception arising in a certain class of digital information 
transmission systems. 

In the information transmission sys terns ^ITs)'fJ'ith 

which we are concerned in this thesis the problem is one of 

detection of a sequence of message symbols in situations. 

wherein the information regarding any particular message 

symbol is spread out over several received symbols. For 
r 

such receives} the optimum receiver is one which examines 

A 

all the received symbols before coming to a decision 
regarding the received symbol 66 3 • Since however 

this would lead to a receiver structure difficult to implement 
in practice one is restricted to processing a fixed number 
of received symbols before making a decision regarding a 
particular message symbol. The optimum receiver under such a 
fixed decoding constraint has already been considered ( see 
[*AB - 703) Ugh - 66 3 ^ this report, we are concerned 



with an interesting alternative approach in which the 
principle of sequential detection is employed and only as 
many received symbols are examined as are necessary to 
make a decision regarding the message symbol with a certain 
predetermined level of confidence. 

Sequential detection was introduced to the 
field of statistical decision theory by A, Wald lWAL-.4i33, 
[”¥AL“473in 1947. Its adoption to the theory of signal 
detection in communication systems dates back to almost 
the same year and various papers exist proposing the use 
of sequential detection to such topics as the detection of 
a sind wave in the presence of Gaussian noise (see Middleton 
and Bussgang ~ In the year 1966, sequential 

detection was suggested as a means of minimizing the 
average number of requests for retransmission over the 
noiseless feedback channel of a feedback communication system 
by Turin [3 tuB" 66 3 • Though a large number of papers have 
been published since then in this area, the idea has not 
been adopted in practice ClUC- first ma^or 

practical application of sequential detection to signal 
detection was perhaps in the field of target detection in 
Radar (see Di Franco and Rubin [^DR - where it was 

shown to result in quicker target detection. 

*** 1 •• 



A characteristic of the class of information 
systems being considered in this chapter is that information 
regarding any particular received symbol is spread over 
several received symbols. To the best of. the author *s 
knowledge, no detection scheme, sequential or otherwise has 
been proposed for this class of information transmission 
systems, though various detection schemes have been suggested 
for specific examples of such ITS*s such as the feedback 
communication system mentioned above. The two most 
frequently encountered examples of the ITS mentioned above 
are communication systems employing convolutional codes and 
communications systems in which a time dispersive channel 
leads to the presence of intersymbol interference. (i*s.i.). 
Various techniques have been presented for the detection of 
message symbolsin both communication systems and we shall 
presently examine in brief a few techniques which are in 
common usage, ‘ Though the nature of the problem of signal 
detection in the two systems is the same i.e. involving 
the detection of message symbols in the case where aevoral 
received symbols contain information relating to a particular 
message symbol, the decoding schemes in the two disciplines 
flourished independently whilst many of the techniques 
proposed for either one of the two systems are equally 
applicable to the other, 
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In the following we have a brief look at the 
three techniques commo3ily employed for the decoding of 
convolutional codes. These are feedback decoding introduced 
by Massey j ssquentiall- decoding introduced by 

Wozencraft {I’''^0Z-573 said Vitarbi decoding introduced by 
Viterbi three techniques can with minor 

modifications be adapted for the detection of signals in 
the presence of i.s.i. The first of these « feedback 
decoding, is a decoding technique in which a decision regard- 
ing the present bit being decoded is made using past symbol 
decision feedback and only such received symbols as correspond 
to output symbols which are linear combinations of the past 

i 

and present symbols. 

This technique has the advantage of being 
simpler to implement though it is prone to error propogation 
effects and has an overall error performance considerably 
poorer than that of either of the two other techniques 
named above. 

Sequential decoding is a decoding technique 
making use of the expected behaviour of the log likelihood 
function (given the received symbols) of the true message 
sequence in order to detect the message sequence. Using only 
a limited number of received symbols and assuming past deci- 
sions to be, correct, the decoder follows a path in the code 


3 



tree making tentative decisions. The log likelihood or 
some other equivalent functions of the estimated message 
sequence is computed and continuously monitored. ¥hen 
the decoder finds the log likelihood fmction hehaviour 
to he anamialousj it goes hack on its previous decisions 
and traces a fresh path in the code tree. This 'decoding 
method has the disadvantage of. requiring a large storage 
requirement as compared to the Viterhi decoder for small 
values K of the constraint length of the convolutional 
code. The reverse is the case for large values of K and 
the sequential decoding technique becomes attractive for 
values of K > 10 or so (see [IVIT-7l[3). The Fano algorithm 
QfA-N “63^ detector -which uses a tlH:ed distance function 
in place of the above log likelihood function is the most 
commonly en^loyed sequential decoding algorithm today. 

The Viterbi algorithm detector described 
in CviT -67, 3, CviT-Tinand Ch 1“71II is a detector 
estimating -the i”^^ block of k message bits (where k/n 
is the rate of the convolutional code ) of the message sequr 
ence considered as the mo.st likely sequence (given the 1st 
(i + blocks of n received symbols each) to be the true 
block of message symbols. For the case when , the 

algorithm would clearly result in maximum likelihood 
sequence detection. However, in practice, a value of 

«.<« 4 ^ 



equal to four times the constraint length of the code is 
commonly employed which value has been found to yield 
decisions having a probability of error nearly equal to 
that of the maximum likelihood sequence detector* However, 
the algorithm suffers from the disadvantage of having a 
storage requirement and computational complexity which 
grow exponentially with increase in the constraint length 
of the code, I'Jhereas the computational complexity of the 
decoder can be reduced by using a serial implementation 
(see for e.g. ^ HJ- Vl^j 75^), the same is not 

true of the storage requirement. 

In like fashion, several detection schemes 
have been proposed for the signals in the presence of inter- 
symbol interference. The receivers currently being used to 
combat intersymbol intereference for the case • when the 
pulse response of the channel is known, can be divided 
into the classes of linear and nonlinear equalizers* The 
optimal linear equalizer having a finite number of tap gains 
was shown by Tufts - 63 3 consist of a matched 

filter followed by a transversal filer. The same structure 
is obtained even for suboptimal linear equalizers optimum 
either in the minimum mean square error sense or else 
optimm in the rainimimi probability of error sense under the 
constraint of having zero i.s.i, at the sampling instants* 



However, linear equalizers have been found to have a poor 
error performance when compared to the statistically opti- 
mum receiver and it is this which lead to the current 
growing interest in suboptimal non linear equalizers. 

Of these, the decision feedback equalizer, the Viterbi 
algorithm receiver and the optimum fixed decoding delay 
receiver have received a considerable amount of attention 
in recent years* 

The optimum fixed decoding delay receiver 
first proposed by Chang and Hancock UCH - 66 3 whose 
receiver was optimum in the sense that it minimized the 
probability of error in detecting a sequence. Bowen 
L.B0WJ ~ 69^ and Abend et al. I^AB - 683 pointed out that 
minimizing the probability of error in sequence detection 
was not equivalent to minimizing the probability of bit 
error and both suggested modifications in the receiver 
structure employed by Chang and Hancock, A modified 
receiver structure, alongwith simulation results obtained 
for the case of a particular tel. channel were then presented 
by Abend and Fritchman QaB-^ 70 3 • However, the optimum 
fixed delay constraint receiver needed the use of exponen- 
tiators thus making implementation difficult. Pointing 
out this fact, Austin CaUS - 67 3 considered a suboptimal 
equalizer employing decision feedback which was optimal 
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amongst all non-linear equalizers having the same structure. 
The receiver structure considered hy- Austin consisted of a 
forward filter opera.ting upon future symbols and a backward 
filter making use of past decisions to eliminate past 
symbol interference. The forvrard and backward filters are 
transversal filters and the tap co-efficients of the forward 
filter were obtained by optimizing for the minimum probabi- 
lity of error under the assumption that future message 
symbols had a Gaussian amplitude distribution. Monsen 
C MON- 71^ and Storey adopted the receiver 

structure employed by Austin and rederived (independently) 
the optimal tap gains using a minimum mean square error 
criterion. No analysis of the error performance of the 
decision feedback equalizer (DFE) is available to date. 

However, simulation results obtained by 

* W 

Monsen [2 MON - 743 indicate for the case of dispersive 
channels having an impulse response confined to a few 
batjd intervals, the performance of the DFE to be not "far 
inferior to that of the Viterbi algorithm detector. 

The Viterbi algorithm detector was presented- i 
by Viterbi [Tvit - 67 3 decoding of convolutional 

codes in 1967, A few years later, the idea of using the 
Viterbi algorithm for the detection of signals in the I 

presence of intersymbol interference was proposed Independently 



■by FoKiey CfoR « 72^ , Kobayashi CkoB -713j CkDB- 723 
and Omm’a (3 mU - 71 3 . However j Goutmann ^ GOU - 723 

and Klein and Wolf -7^3 conceived some what earlier 

the idea of treating the problem of intersymbol interference 
using techniques borrowed from coding theory. Whereas 
Goutmann considered the application of the FANG decoding 
algorithm for the detection of signals in the presence of 
i.s»i., Klein and Wolf suggested the use of i.s.i. for 
error correction. 

1.2 Organization of the Thesis 

The thesis is organized as follows. In 
Chapter II, the principle of sequential detection is 
explained and the question regarding the applicability of 
sequential detection to communication systems raised. In 
partial answer to this query, an information transmission 
system (ITS) model to which sequential detection could be 
applied is presented. The ITS model considers an additive 
white Gaussian noise (A.WGN) channel, though such a restric- 
tion is not necessary for sequential detection to be 
applicable. However in the case of any other channel, the 
applicability of the sequential detection techniques presented 
in this report must be examined afresh for each particular 
channel. The proceedure followed by a sequential detector 
for such an ITS is then outlined and finally few characteris- 
tics common to every sequential detector are discussed, 

8 - 



In. Chapter III, a sequential detector 
employing the sequential probability ratio test (SPET) 
is considered. The sequential detector is seen to have a 
comparable error performance to that of the optimum fixed 
decoding delay receiver but requiring for its ' implemen- 
tation, a far lesser number of computational elements. As 
against this, the sequential detector has a lower decoding 
speed. The chapter is concluded with a presentation of a 
conservative bound oh the bit error probability of the 
sequential detector. 

In Chapter IV, a sequential d etec tor employirg 
a ML criterion is considered. The sequential detector 
is seen to have a comparable error performance to that of 
the Viterbi detector though requiring for its implementa- 
tion a far lesser storage requirement. As against this, 
the sequential detector has a lower decoding speed. An 
extension of the generating function technique introduced 
by Viterbi is then employed to derive upper bounds on the 
probability of bit error as well as the Average Sample Number 
(ASN) of this sequential detector. The buffer requirement 
of the detector is also discussed and the chapter finally 
concluded hy the presentation of extensive results obtuined 
through evaluation of the bounds mentioned above as well as 
through simulation of the detector on a digital computer. 
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In the last Chapter of the thesis > 
Chapter V, the conclusions to he arrived at given the 
material of Chapters II j III and IV as well as the 
possibility of future work in this area are considered 



CHA.PTER II 


SEQIBMIAL DEISCTION AND IIS APPLICATION TO DIGITAL 

GOMMUI'IICATION SYSTEMS 

Iq this Chapter} the principle of 
sequential detection is introduced and it is sho\'jn ho¥ 
one may employ sequential detection to detect data in a 
certain class of information transmission systems. In 
Section 1, the topic of sequential detection as applied 
to general statistical decision theory is dealt with. 

In Section 2, the possihility of applying sequential 
detection to a digital communication system is then consi- 
dered and several examples of such communica.tion systems 
where one might use sequential detection are mentioned. An 
information transmission system model to which sequential 
detection can he applied and to which all the communication 
systems mentioned above confirm is presented in Section 3. 

The procedure adopted by a sequential detection in the case 
of such an information transmission system is outlined in 
Section 4 together with a discussion on a few characteristics 
common to every sequential detector. 

Z ,1 Sequential Detection. 

Consider a situation in which one is 
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alDle to make several observations on the outcome of an 
experiment having one of two possible results. Let the 
observations be unlimited and also noisy in the s ense that 
the observations are not quite sufficient to tell us defini- 
tely as to which event has occurred, but can only inform us 
in a probabilistic sense. Then briefly, sequential detection 
(see Wald ]]] ) is a technique which makes use of 

only as many, observations as are necessary to make a decision 
regarding the outcome of the experiment with a certain degree 
of confidence. Whether or not the desired level of confidence 
has been attained is determined by subjecting the observations 
to a test which we shall refer to as the sequential detec- 
tion test (SDT) , To illustrate the above, we now consider 
the example of target detection in Radar. 

'The antenna sweeps the sky repeatedly 
and each sweep brings in- a return from the target region. 
Before sequential detection was introduced, the method 
commonly employed vras one in which a fixed number of 
returns were examined.. On the basis of these, the decision 
as to the presence or absence of a target was made. Such a 
detector is called a fixed sample size (FSS) detector* 

In the case of sequential detection, 
the observation space is divided into three regions s- 
A region R^ in which the target is declared to be absent, 

A region R^ in which the target is declared to be present 

- 11 - 



and A region in -which the ne3rb ret-urn 
is a-waited . 


The receiver- examines 
the first return and either makes or does 
not make a decision depending upon the region 
of the observation space in -which the return 
happens to lie* If no decision is made, the second return 
is examined and so on. 



Pig .2 .1 
Observation 
Space 


-1:/ 

It has been theoretical^ proved that 
the average number of returns from the target region ejcarained 
by the sequential detector in such a case, is lesser for a 
given probability of target detection as compared to the 
fixed sample size (FSS) receiver mentioned earlier, thus 

resulting in quicker target detection. For a more detailed 

> 

description of this topic the interested reader is referred 
to Difranco and Rubin CdR - 683 


^,2 Applicability of Sequential Detection to Digital 
Communication Systemr . 


Now, in a digital communication system, 
one is in general, concerned with the detection of a message 
symbol on the basis of one or mors than one received symbols. 
It is apparent that sequential detection can be applied only 
in the latter case. Several examples of such communication 



systems come to mind such as the detection of signals in the 
presence of intersymbol interference, the decoding of 
convolutionally encoded data and the detection of signals 
in the presence of a feedback channel using the automatic 
repeat request (ARQ) scheme. Its application to the last 
mentioned of these was first suggested by Tirrin OcUB-Sen 
In each of these cases, information regarding any specific 
message symbol is spread over a span of several received 
symbols . 

Rather than discuss the application of 
sequential detection to each of the above systems in turn, 
we will consider Instead an information transmission system 
model to which each of the above systems can be reduced, 
will then apply ourselves to the far simpler task of descri- 
bing the application of sequential detection to this model. 

Z,3 The Information Transmission System Model. 

The information transmission system 
model which we consider in this Chapter consists of a finite 
state machine (FSM) encoding the output of a message source, 
a modulator mapping the output alphabet of the FSM into a 
set of real valued parameters suitable for transmission, a 
channel introducing additive white Gaussian noise and a 
receiver making an estimate of the message sequence based on 



the channel output, (see Fig. 2.2). For the sake of 
clarity in description, \ie shall confine our attention 
here to the class of FSM'*s having the "binary input alphabet 
13 * Such a machine may be represented by the 5- tuple 
< I , Q , Z , d, w ^ (see CbTH - ) where I and Z denote 

the input and output alphabet, Q the set of states and -where 
5 and -w denote the next state and output mapping functions 



Fig, 2.2 Information Transmission System Model. 

Figures 2, 3- a, b and c show the 
state diagrams of the FSM which will be used to model the 
information transmission system (ITS) in the case of a 
convolutional encoder, a time dispersive channel and a trans- 
mitter employing ARQ respectively. The state diagram for 
the case of convolutional codes is self explanatory. In the 
case of ARQ, a slight- modification must be made in the infor- 
mation transmission system and a feedback channel having the 
ability to control the state of the FSM introduced between 
the transmitter and the receiver as indicated by the dotted 

—Id— 







lines in Fig. 2*2. In this schemej the transmitter keeps 
retransmitting the latest symbol for as long as a request 
for repeat is maintained. In the absence of such a request 
of course, the current message symbol is passed on to the 
modulator. States BO and B1 represent the machine in its 
retransmit mode whilst states AO and A1 correspond to the 
no^'mal mode of transmission. The input in this state diagram 
is a 2 component vector representing data received from both 
the message source and over the feedback channel. 

"Whilst past data are being retransmitted, 
the FSM keeps the input from the messa.ge source pending. This 
escplains therefore the presence of only three symbols in the 
input alphabet of the FSH:- C ( o ^ ^ 0 ^ ( 1)31 

where 0 indicates an absence of message data during re- 
transmission. Of course, the loss in time due to retransmi- 
ssion is made up in the interval bstx^een transmission bursts. 

In the case of i, s, i, we use the 
FSM and modula.tor to repr ^duce the signal at the output of 
the whitened matched filter (see Fomsy FOE-72 3 ) at the 
receiver end. The signal consists of a sequence of discrete 
time samples in which each received sample is dependent upon 
the corresponding message symbol as well as those prior to it. 
In the model we have shoxm, each sample is a function of the 
present and immediate past inputs to the FSM and this 
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Fig, 2.3a Rate 1/2 Convolutional Encoder with ..;K= 3 



= h^ + h^ where = + 1 , if z-^ 1 


oc^ - -I 5 if - 0 i=l, 2 . 

Fig. '2.3b. ISI model for the case when impulse response spreads 
over 2 baud intervals. 
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Fig. 2s* 3c FSM model for transmitter employing ARQ 


where 5 t 



Z = Co, 13 


Vjj, = h where 

h is a constant. 


<=(, = +1 if z. 
k . 

= -1 if z. 



corresponds -to the case of a channel having a pulse response 
ejctandirg over two hand intervals. The relative values of 
h^ and h^ can be shown to be indicative of the relative 
signal energy in the first and second baud intervals. 


1.4 Sequential Detection as applied to the ITS Model. 

We will in this Section describe the 
sequential algorithm as applied to the ITS model just 
discussed and then go on to consider a few fea-tures of 
sequential detection. The algorithm proceeds in such a way 
that prior to the detection of the message symbol the 
symbols r^^, rg , j £^..1 have already been processed 
and the result stored. The first step is therefore process- 
ing the symbol rj_ , after which the sequential detection 
test (SDT) is applied, ks in the case of target detection 
in Radar, at any stage in the detection process, the observa- 
tion region is divided into three regions 
A region R^ in which x^ is declared to be 0 
A region in which is declared to be 1 
A region R_ in which no decision is reached 
and the next received symbol is examined. 



Fig. 3.4 

Hence, depending 

Observation Space 

upon the region of the observation space 

in which the' received symbols happen to lie, either a 
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decision regarding the symbol is made or elsej the next 
received symbol r^ is examined. This process is then 
repeated with the symbols » £i+2"''^”^ succession . 

(We note here that the processed result after the symbol 
r^^^^ has been examined is stored to initiate the detection 
process for the next bit upper limit of ■fl) 

future symbols are examined beyond which the test is forcibly 
terminated since it is possible that the sequential detector 
may in some cases, observe a very large number of future 
received symbols without being able to satisfy the sequential 
detection test. 

If we denote by pCj) the probability 

that the test will terminate after the observation of the 
'fell 

3 received symbol, then the average number of future 
symbols observed ( considering r, to be the first future 

i + Nm - I 

symbol) is given ty 2 C3-* i+1) . p(i)« He will refer to this 

3 - i 

quantity as the average sample number (ASK). Ifence we have 


i 

ASN =2 (3 - 1+1) . p(3) 

3 = i 


... ( 2 , 1 ) 


Since there is a variable decoding 
delay in the sequential detection process it follows that 
a buffer is required both at the input and the output of the 
receiver. Whereas, the input buffer requirement arises from 
the fact that the incoming data arrive at constant intervals 
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of time, but are processed with a varying delay, the output 
buffer is needed since decisions are made irregularly but 
need to be put out at constant intervals of time. 

The importance of the ASN may readily 
be appreciated from the following i 

Let be the maximum number of received symbols that can 
be processed by the receiver in 1 sec. Then we see that the 
maximum data rate n^j at which we can operate is given by 

rip < in^ / ASN ) ... (2 .2) 

Hence we see that the ASM determines the maximum bit rate 
capability of the sequential detector. 

¥ith this, VJ 0 conclude our description 
of the sequential detection algorithm. ¥e have deliberately 
not specified the nature of the SDT to be employed since 
many different tests could be used with varying consequences 
and indeed in Chapters III and IV we deal with sequential 
detec‘’'ion using two different sequential detection tests. 
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CHAPTEB III 


SEQUENTIAL DETECTION USING THE SEQUENTIAL PROBABILITY 

RA.'.IO TEST 

In this .Chapter we consider for the 
information transmission system model outlined in ChapterjSj 
a sequential detector using the sequential prohahility ratio 
test (SPET) , To begin with, we examine in Section 1 the 
optimal fixed delay constraint receiver for the ITS model 
and show how it may he implemented in two ways one of which 
is recursive and the other semi- re cursive , It turns out 
that of the two proce- dures, the one which is semirecursivs 
in nature is the one that is. simpler to implement though 
having a far lower decoding speed. This receiver which we 
consider in Section 2, is analogous to the fixed sample size 
detector mentioned earlier in the example of target detection 
in Radar. Ue modify the structure of this receiver using 
sequential detection instead of FSS detection and obtain a 
receiver structure which whilst sharing the reduced complexity 
of the FSS detector has a considerably greater maximujii bit 
rate capability. In Section 3, we show how such a detector may 
be implemented in practice and then go on to present in 
Section 4 an upper bound on the bit error performance of this 
detector. Finally, we conclude in Section 5 with a discussion 



on the relative merits and demerits of such a sequential 
detector. 

3.1. The Optimum Fixed Decoding Delay Eeceiver. 

The optimum receiver (in the minimm 
probability of error sense) for the ITS considered in this 
report is one which evaluates the ratio 

Pr ( j j • . . • } XpQ ) 

1 

Pr (H^ / £;]_> £ 2 } ) 

in order to detect the message symbol x. and declares x 

^ i 

to be a 0 or a 1 depending upon whether the ratio is greater 

or lesser than uni'ty. Here and stand for the 

fh 

hypothesis that the i message symbol is a 0 and a 1 
respectively. Such a receiver is clearly not possible to 
implement in practice and hence we are led to consider the 
optimum receiver operating under a fixed finite decoding 
delay constraint D. By a fixed decoding delay D, we mean 
that an interval of D baud intervals elapses between the 
arrival of the symbol r^ and the detection of the symbol x, . 
Such a receiver would clearly evaluate the ratio 

Pr ( ^2^ •* * *f ) 



before making a decision on the symbol as above 

Alternatively, since 


P %+D / K- 


Pr C > ^ 2 * * * * **"i+D ^ 


j — 


Pr ( hJ ) 


^ P( El> ^ 2 * •**» ^i+D ^ 

and we assume that the a priori probabilities of the symbols 
0 and 1 are equal , the receiver could equivalently evaluate 
the ratio 

o 

p^ ^2> ^i+D / ^ 

^ ^ ^ I I III . 1,1 , 1 . I I I * 

P^ £l» £2’ » £i+D ^ ^i^ 

Such a receiver has been considered by Abend and Fritchman 

Cab - 703 for the particular case of a channel having 

intersymbol interference. The following material on this 

optimum receiver is an adaption of the recursive structure 

employed by them to the more general ITS considered in this 

report. The structure is '-alid only for ITS*s in which the 

FSM is such that its output is a function only of a finite 

number *L* of the immediate past symbols fed to it by the 

message source. ¥e will therefore confine ourselves to such 

as 

ITS*s in this Chapter. Also^one would logically expect, 

Abend and Fritchman obtained simulation results indicating 
that a choice of D < L resulted in a severe loss in performance 
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as oomparsd to choices of D ^ L and we shall therefore 
consider the latter only in this report. 

The recursive structure considered 
by Abend and Fritchman for such a receiver is described below. 
It is assumed throughout that the message symbols are indepen- 
dent of each other and that thf ir a priori probabilities are 
equal. ¥e have, 


p( r^, rg, . . . / H^) 


i+1* ^+2» ••••»^i+D X PrfH H H ) 

...(3.1) 


“.U -I”"’ 


Also, 

p ( r^^, . . . . > 

= P( SjL+D / \+d ^ • I *3.11 H %»**»-^i+D-l 


^ \-l’ ^i+D-l 


) 


...(3.2] 


where Hj|_, ..., H^ 4 .£) stands for a hypothesis regarding the 
sequence ^i+l> **•» ^i+D" Hence, we have obtained a 

means of recursively evaluating p( r^^, .» .,.,11^^^^^) 

for i = 1,2, ...for all possible hypotheses and 
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o 

these can he used in equation (3.1) to ohtain p( ^ 

1 

and^ p( and - hence the probability ratio 

needed for the decision to be made . 

To f J-ustrate this nethod of computation, 
•we will rewrite equations (3.1) and (3.2) in vector form for 
the particular case 1=1 , D = 3. (see -equations (3.3) to 
(3.5) ). 

lie denote s 

"by i the conditional density function vector 

on 'the LHS of eqn. (3.3a) 
by TrA(i) , the transition matrix in eqn, (3.3a) 

by irA^(i) and irAg^jthe two matrices into which 

irA(i) is split, 

i.e. irA(i) = vA (i) , vA ...(3,6) 

m a 

by EA(i) , the conditional density function vector 
on the LHS of eqn. (3.5a) 
by dk , the transition matrix in eqn. (3.5b) 

and by SA(jL), the vector = i . tA , QA.(i«.l) 

i.e. ^(i) = i . ttA^ . QA (i-l) 

...(3.7) 

To detect the i^^ message symbol, the 
receiver proceeds as follows:- 
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* • • CS * 49 . ) 

i.e. ttA (i) = ttA <i) , irA (3*4t)) 

m a 




19 _ 

liiiiiii 

p( r^> .» 


11111111 


% 

... (3.5a) 


i.e, £A(i) = dA , gk (1) 


(3.5Td) 



s tep I 


The conditional density fmction vector SA(i) 
giving the conditional density functions 
P C • • • • \+i • • • ^ possible 

combinations of %+l • • • ^i+dH available from the 
previous calculation . The first step is then the evaluation 
of the elements f^ f^ fg fg -which for the additive Gaussian 
noise channel we are considering will involve the use of 
exp onentiator s , 


Evaluation of the conditional density fianctions 
comprising the vector ^(i) as follows 


^(i) = TA^Ci) . 


i . irA^(i) • QA(i-»l) 


= TrA^(i) . SA <i) 


This matrix multiplication is a process in which one clearly 
requires the use of 16 multipliers if parallel implementa- 
tion is desired. In general one would need 2^'^^multipliers. 


Computation of the conditional density functions 
comprising the vector PA (i) according to the equation:- 

EA(i) = ^ACi) . ^(i) 

This clearly involves two additions to be performed and the 
number of additions is invariant with respect -bo L and D* 
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s tep 4 

fef ^ i 'n mt r:m 


Using the elements of PA(i) » one computes the 
prohahility ratio 

P( ?1» fi+g/Hi) 

Jl* £ 2 * V*^ ~i+3^^i^ 

If the ratio is greater than 1, the symhol is declared 
to he a <0* otherwise a *1’. 

To obtain and store the conditional density functions 

needed for the detection of the symbol x. To do this 

1+1 

we evaluate:- 

§k (1+1) = g . 2^(1) 

D+1 

which is a process involving 2 additions. In general^ the 

vector (i+1) will comprise of 2^"^^ terms (16 in this 

case) of which only 2^ are distinct as is obvious from the 

nature of irA , 

SI 

This proceedure is then repeated with succeeding 
symbols. The reason for splitting up the matrix TrA(i) is 
to bring out clearly the number of multipliers , adders as 

well as the amount of storage needed. In general, one would 

D+1 D+l Jj+l. 

need 2 multipliers , (2 +2) adders, 2 oxponentiators 
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and storage place for 2 analog samples in order to implement 
this receiver. 


3.2. An Alternative Implementa.tion. of the Optimum Fixed 
Delay Receiver. 

¥e -will now consider an alternative proceed ure 
for evaluating the density function ratio 


P( Si> £si Ei+i/i^> 


for i = 1,2, .. 


The proceedure is semi recursive in the sense that whilst 
the processed result of past received symbols 
is used directly, the future symbols ( r^, • • • • 

are examined afresh before the density function ratio 
indicated above is evaluated. 

We begin by assuming that the conditional density 
functions pC • » • , for all 

combinations of hypotheses I^_x ^'l+l-L **" ®i available 

to us from a previous computation. Then, we proceed to 
evaluate recursively P ( fg, . , . . , ^ 

f 3 ^ D 3.S f ollcvrs x 



P ( jP2» * * •> ’ * ^i+j ^ 


i+j* 


« • • ♦H , . • T ) • 


■ --\ pCrj_, ...5 ‘i+i«i' 

all 


^ pC ^\*\+3-L*** ^+3^ 

^ H^^.) ...(3-7) 

Clearly, Pr( / ^i’^i+3*-L‘ * ■* ^i+j^ 

fact we shall use in the example to follow . This factor 
= . ^ or 0 depending upon the compatitility of the. set • 

4G 

of hypo these, s (H^, ^i+3-1^ * 


The conditional density function p 
can he evaluated as : - 


p( Si > = 2 p( r 

i all 


■1' •**’~i+/^’^+3-L* ••^3^ 


K. H- 

i+ 3-1 ' i+3 




... (3.8) 


As above, the value of Pr ( ^i+* will be 

1 1 

either “|]+X ’ '“ y * " ® depending upon whether 3>/L 

2 2 

and also upon the compatibility of the set of hypothesas 
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whenever this factor is a 


®i+3-L--- Hi ). However , 

0, the conditional density fmction mtxltiplying it in 

equation (3.8) will also be =0 and hence we can without 

1 

loss in accuracy, put this factor = always where 

s 

S = Ir-1 0 < L 

= 1 otherwise . 


The conditional density functions needed to begin the 
detection process for the next bit evaluated 

as follows s- 


P C ’ »£i+i/\+i-L * ' • \+l ^ 


i+l' 

~ all H -l^*’*»~i+l^%+l-L** • ^i+1’ ^i^ ^ ^i^^i+l-L'* 

^ ...H ) 

i+l 


... (3.9) 


Here again, we note that the factor 


Pr( H./H _ _ H, ) will be = 1 or 0 depending upon 
x 1+1*- L i+l 

the compatibility of the set of hypotheses (H^^^, . 

For the identical reason put forward above, we can set this 
quantity also = 1 without loss in accuracy. 


The equations (3.10) to (3.15) shown below 
illustrate the computations indicated by equations (3.7) 
to (3.9) for the particular case of H = 3, L = 1 also 
considered in the previous section. 
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... (3.11b) 


i,e. ttB^U) = 'rBj_^^( 5 ) . 
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1 

.. » 

nil 


j 

L 


(% (j) 


(3.12a) 


i.e. PB.(j) = dB . (^iQ) 


.. . (3.121) 


^0 = P^~i+/\+3-l^+3‘^' ^1 
^2 " ^^i+3^^+3-A+3^^ ^3 

12= 

^3 = 


= P^i+/^+j_i^+3^ 


. .. (3.13) 


<15 = 


..,(3.114) 



¥e denote "by s~ 


the conditicaial density function vector 
on the LHS of equation (3.10a). 
irB^Cj) the transition matrix in equation (3.10a). 

irB„ . (3 ) and iiB . (3 ) the two matrices into which 
ul| X X 

TrB^(3) is split i.e., 

C3). <3) 

PB (.1 ) the conditional density vector on the 
LHS of eqn. (3.11a). 

and hy dB the transition matrix in equation (3.12a). 


We novr describe the. s equence of operations performed 
hy the sequential detector in order to detect a fresh message 
symbol , 

Step 1 . 

Using exponentiatorsj the sequential detector 
evaluates f^ according to eqn. (3.13) and 

putting 3 - !• Along with these factors the factor q^ to 
q^ are also evaluated . 

St ep 2 . 

At the beginning of the recursive proceedure in 
detecting x^ } the vector ^Bj ^(O) has to be constructed 



given til® vector C|B^ ^ (1 ) evaluated during the detection 
of the previous symhol Ho^Arever, we note that :« 







0 

0 



P( Il» 


0 

0 


0 


0 

0 

1 

0 

1 1 

Sl****> 


P( 

1 1 

0 

J 


P • • • J I^) 


and hence a mere transfer of components achieves the 

desired result. The sequential detector then goes on to 

multiply the vector QB4 (0) ty the matrices aCj) and 

— ^ L+2 

’"'^i,m which process involves 2 additions ( 8 in this 
case) and multiplications. ¥ith this, the vector QB. ( 1 ) 
has been evaluated* 



From the vector QB^ (1) and using eqn. ( 3 . 12 a), 
the detector computes the elements of which process 
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involves two additions. 




The probability ratio is then computed from the 
elements of PB^Cj). If j = N , the ratio is tested against 
unity and dependlrg on whether it is lesser or greater than 
unity a decision regarding is taken. 

The following step is performed, only when j = 1. 

The eleaients of the vector op (1 ) are stored as they will be 

needed in the detection of the next symbol x. 

1+1 

Steps 1 to 4 are then repeated for j = 2,3, 

until at 3 = } the test is terminated at step 4 with a 

decision on the symbol x^ . Thus we see that the sequential 

1+2 ^ 

detector employs (2 + 2 ) adders, 

L+2 

2 ..multipliers, 

t .|..n 

and storage sufficient for (2 + 2"^ ) analog samples 

constituting the elements of the vectors and 

respectively. This is as opposed to the (2^*^^ + 2) adders^ 

D+1 

2 multipliers, 

and .. storage space for 2^ analog samples required by 
the fixed decoding delay receiver structure suggested by 
Abend and Fritchman. 

Hence, we see that this receiver which is akin to 
the FSS detector considered in the example of target detection 
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in Radar because it examines sequentially a fixed number 
D of future symbols before coming to a decision, has a 
reduced computational complexity as compared to the recur- 
sive structure considered in Section 1. However, the 

T 

decoder speed is clearly reduced by a factor of as 

a result. To make up for this loss, we introduce the 
seq-uential detector which retains the computational advan- 
tages of the FSS detector. 


3.4 The Sequential Detector 


The prooeedure adopted by a sequential detector 
has already been detailed in Chapter II and we will therefore 
confine ourselves to specifying the specific sequential 
detection test (SDT) adopted by this detector. The sequen- 
tial detector begins with the vector (1) of 

conditional density functions evaluated during the previoiis 
detection process. Examining an additional future received 
symbol each time, the receiver evaluates successively the 
probability ratio i - 


P ( * * • ’-i+3^^ ^ 


for j — 1, 2, 


using exactly the same proceedure as that of the FSS detector 
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outlined in 3.3 and tests the ratio against a predetermined 


threshold A. 


If 


PC 


the deisector declares 


X. 

1 


= 0 


If 


P^ -1* * * 

p( 


1 

A 


the detector declares 
= 1 


and if neither is true, the detector examines the next 
future symbol and recomputes the probability ratio for 
3 = j + 1 . If for all 3 0 < 3 < D , the test does not 

result in a decision, the detector tests the ratio 


P ^ j • • • • i ^ 

against a unity threshold thereby 

pC 


ensuring forcible termination of the test. This SDT is commonly 
referred to as the sequential probability ratio test (SPET). 


All the statements made in Chaptei H regarding 
the general sequential detector hold good for ttils detector 
also. The average sample number determines the maximum bit 
rate capability of this detector and the variable decoding 
delay causes a buffer requirement both at the input and 
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output of the detector* Fig. 3,1 shovs how such a sequential 
detector may he implemented, The inpu t section computes the 
conditional density functions f^, fg, fg.,,, using 
exponentiators . Storage s. ctipn A- stores the vector of 
conditional density fianctions 2,^^^ needed to begin 

the detection of the symbol Xj_. The muli^ iply a nd adij se ction 
performs the additions and multiplications indicated by the 
transition matrix in eqn. (3 .10a), and the adders 

perform the addition indicated by eqn. (3.12a) in order to 
obtain the components of vector Pg^Cj) . Tho main sto rage 
flection stores the components of the vector ) needed 

during a detection process and finally, the threshold^ devic e 
checks the probability ratios appearing at its input against 
the threshold A, An input and out put buffer are of course 
needed on account of the varying decoding delay. 



Threshold , 
detector 


Fig . 3 .1 . Implementation of the sequential detector 
employing the SPRI . 
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3,6 Bomd on the Prohahility of Error of the Sequential 
Detector . 


¥e -will now proceed to hound the error 
prohahility of the sequential detector using the SPEC . 
hJe will designate hy PE (3) the prohahility of making an 
error in detection after 3 future received samples r^, 
-i+l> ^i+2 >***‘> ~i+j-.l been observed. At this stage, 

the observation space is divided 
into three regions :~ 

where (3 ) ^ is 

declared = 0 , 
where — and is 


declared = 1, 

where ~ < R. (3) *< A and 

° A i 

no decision is taken. Here R. (j) refers to 

i 

the ratio 


0 

^2*****’ “i+3^^i ^ 
£i> Jsi ••••> 5 


Hence over Rq we have :~ 


,0 


P( ^ 2l» 


3 9 



Integrating over the entire observation space, we obtain:- 
Pr( - say k Pr( say hJ; / ) 

... (3.15a) 

Similarly, we can obtain T:y considering the region thats- 
Pr( say ^ A Pr ( say /H^ ) 

... (3.16b) 

Adding the left and right hand sides of equation (3.16a) and 
(3.15b) we obtain 

Pr ( correct decision ) ^ A Pr ( errcneous decision) 
i.e. ( 1 - PE( 3 ) ) ^ A PE(j) 

. 1 

* . we have PE ( 3 ) < ... (3 .16 ) 

1+A 


Clearly, the equation (3.16) holds for all j 0 < J < D. 
The bit error probability of the sequential detector is 
given by j ~ 


D-l 

PE = 2 p(j).PE(;))^ 

3=0 

1 ]>1 

^ 2 p(3)'+ 

1 + A 3-0 

1 

and hence PE ^ — — -t' 

1+A 


j^(A,o) » (a ^ri) 

pefAj])). 

|^(A ) n) » pE- (a 1 , 


...(3,17) 
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Therefore the hit error prohahility of the sequential 

deteotor can he raade close to that of the optiijial fixed , ,, a 

p(A,P). FE (A ) 

delay detector (whose ppohahility of error is r 
by ©hosing a suitably larfe,Q value of A. He cannot choose 
an arbitrarily high value of A since this would inci^ase 
the ASN thus decreasing the decoding speed of the detector. 

3 .6 Conclusions . 

The table below shows the number of multipliers, 
adders and the storage space needed by the optimum fixed 
decoding delay receiver using the structure suggested by 
Abend and Fritchman as well as that needed by the sequential 
detector . 


Table 3,1 



Fixed" delay 
AQppdej^ 

Sequential 

detector 


D+1 

L+2 

Adders 

2 +2 

D+1 

2 +2 

L+2 

^ Multipliers 

2 

D 

2 

1+2 L+1 

Storage space 2 

2 +2 


Hence, we see, that the amount of saving that will result 
will depend on the relative values of D and L, If one 
considers D = 2(L + 1) as suggested by the results presented 
by Abend and Fritchman (a6 - 70) for the case of inter symbol 



interference, then for a typical value of L = 5 we 
retaTjulate the requirement of computational elements. 



Fi^d Delay Decoder 

Seq^, Detector 

Adders 

Multipliers 

Storage 

2^1 + 2 = 2050 

2^^ = 2048 

2^^ = 1024 

2^ + 2 = 130 

2*^ = 128 

7 6 

2^ + 2 = 192 


Table 3.2 


It might be argued that the sequential detector 
has a loss in decoding speed by a factor of and 

hence it is only fair to compare the sequential detector 
with a fixed delay decoder using a sequential implementar* 
tion having times the number of elements shown in 

Table 3.1 « However, even if one considers a value of 
ASH = (L + 1) we see that the difference in requirements 
is still considerable and what is more will grow exponen- 
tially with the value of L. 

Thus, the sequential detector employs a recursive 
structure which for moderate to large values of L and D will 
result in a considerable saving of computational and storage 
elements. Hovrever, both detectors considered above need 
exponentiators for implementation and, considering the present 
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state of hardware development, it seems nnlitely that 
such a receiver will be implemented in practice* We hence 
txirn our attention to a more practical decoding algorithm 
in the next chapter namely , the ma2d.mum likelihood (ML) 
seqLuence detection algorithm. 



CmpTEB IV 


SEQUENTIAL DETECTION EMPLOIING A ML CRITERION 

In this Chapter, we consider a sequential detector 
which uses a maxiimnn likelihood criterion for conducting 
the sequential detection test (SDT), 

The ViterM algorithm receiver which is a practical 
version of the ma^cimum likelihood (ML) sequence estimator 
employs a recursive structure having an excessive storage 
requirement ^Vifcerbi T/'Ie therefore propose 

in Section 1, an alternative recursive structure which does 
away with this storage requirement though at the cost of a 
serious loss in decoding speed, ¥e then present in SectionR, 
a modification of the above sequential detector which while 
retaining the advantage of a greatly reduced storage 
requirement makes up to a large extent the loss in decoding 
speed. ¥e show in Section 3 by obtaining an upper bound 
on the bit error probability of this detector that its 
error performance is comparable to that of the Vitarbi 
algorithm detector. In Section 4, an upper bound on the 
Average Sample Number (ASN) of the sequential detector is 
presented. Here we also consider its buffer requirements 
before going on to conclude the Chapter in Section 5 with 
a presentation of simulation results and the ccnclusions 
to be drawn therefrom, 
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4.1 The non-recursive ML Sequence Estimator, 

As we have seen in the previous chapter, hoth the 
optimriin detector and the sequential detector using the 
SPEI have need of exponent aators which, in practice, are 
difficult to realize. It is for this reason that the 
search for suhoptional detectors combining good error 
performance with ready implement ability continues. Ctoe 
such decoder is the ML sequence decoder. The ML sequence 
detector is that which examines all possible message 
sequences before choosing the one which is the most likely 
given the received symbols. If a long stream of bits is 
transmitted as in practice, then it will not be practical 
to store and compare all possible transmitted sequences 
and accordingly, a modified version of ML sequence detection 
namely the Viterbi detection algorithm is often used. 

The Viterbi algorithm receiver described in 

C!vIT- 71 3 I CfC)^“ 713 suffers from the disadvantage of 

having a storage and computational complexity which grow 

exponentially with the memory of the FSM, For example, 

practical decoders for rate (k/n) convolutional codes having 

a constraint length K and employing a decoding delay of 4K 

k(K-.l) 

have a storage requirement of 4.kK. 2 bits. This 

storage requirement arises from the nature of the algorithm 
which recursively evaluates the ’’survivors” as well as their 



’’metrics”. An aiternative proceedure would be to evaluate 

the survivor metrics afresh for each new bit being decoded 

thus doir^ away with the need to store the survivors 

themselvss. To see how this may be done, consider the 

trellis drawn below for the case of a rate i convolutional 

2 

code having a constraint length K = 3 and whose generator 
polynomials are given alojigside the figurej. 

th 



G. (D) = 1 + D + ) 

= 1 + . : 


In the Viterbi algorithm, one moves in the trellis 
from one node level to the next recursively evaluating the 
metrics of the survivors as well as the survivors themselves 
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at each node level. In this recursive proceedure^the i'' 
message syrnhol of each survivor is computed during the 
recursive computation involved in going from the i^^ to 
the (i + 1)^^ node levels, Hovever, a decision regarding 
the i^^ message symbol is reacted only after the survivors 
as well as the survivor metrics at the (i + N^) node level 
have been computed. Clearly therefore, it is necessary to 
store the i"^^ message symbol while moving from the (i+l)"^^ 
to the (i + node level of the trellis. Similarly^ it 

is necessary to store the (i+1)^^ message symbol during each 
of the recursive computations needed an order to move from 
the (i+2)^^ node level to the (i + + 1)^^ level and so 

on. Hence we need to store the (i+l)^^ to the 

th 

(i + message symbols of each survivor at the (i + 1^) 

node level malting a total of bits in all. (The 

i^^ symbol may be disct'rdad as soon as a decision is made). 
This is the reason for the survivor storage requirement of 
the Viterbi decoder. 

We had earlier on mentioned a recursive proceedure in 
which the need for this storage requirement is done away with. 
In this proceedure, we propose that we start with the metrics 
of the survivors at the ith node level at the start of the 
decision making process in volving the i”^^ message symbol 
instead of the metrics of those at the (i+ 1^~1)'^^ node level. 
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The metrics of the survivors at the (i+1)^^, (i+2)^^, ♦ 

node levels are then successively evaluated using 
a set of add compare select •. operations (ACS) lust as 
in the case of the Viterhi detector. During the recursive 
computation involved in moving from the i^^ to the (i+1)^^ 
node levels, we compute the i^^ message symbol of each of : 
the survivors, but thereafter when we move on to the 
sunaiiS33lv.3 node levels, we do not concern ourselves with 
the successive message symbols of the survivors bu’*' 
maintain only the metrics of the survivors and the i"^^ 
message symbol corresponding to each survivor. Also, after 
reaching the (.Ii+1 ) “ node level, we store the metrics 
of the survivors at this node level since we will be in 
need of them to begin the detection of the next symbol 

■Ml 

^i+l* we have reached the (i + I^) node level 

we make the decision regarding the i^^ message symbol 
lust as in the case of the Viterbi detector since the 
i^^ message symbol (and only the i"^^ message symbol) is 
available to us at this node level. Hence we have 
succeeded in reducing the storage requirement from I^.Np 
bits to a mere Hj, bits * (An additional storage space is 
needed by this detector however^ to store the metrics of 
the (i+1)^^ node level needed to begin the detection of 
the symbol gain in storage requirement is 
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achieved at the cost of a loss iii decoding speed since 
we have to go through the recursive proceedure involved 
in going from one node level to the next times. 

Since the decoding speed of this receiver is clearly 
— — that of the Viterbl decoder, we follow the steps 

taken i-n Chapter III under similar conditions, and 
introduce sequential detection to make up for this loss 
in decoding speed. 

4*2. Sequential Detection Using a IfL Criterion. 

Before we discuss the.SDT employed ly this sequential 
detector, we introduce the following notation r- 

We shall denote hyS?, . and S^. . . the survivors 
th ^ ^ ^ 

at the (i+j node level having greatest metric amongst all 
those having 0 ■ and = 1 respectively. 

The proceedure adopted by the sequential detector is 

identical to that mentioned in Chapter 1 and the recursive 

structure it employs is identical to that in the previous 

section. The sequential detector begins with the metrics 

th 

of the survivors at the i node level and thereafter 
recursively evaluates using a set of ACS (add, compare, 
select) operations . (see Heller and Jacobs C®- 7 13 ) , 
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the node metrics at successive node levels. After the 
metrics of the survivors at the (i+3)^^ node level have 
been evaluated, they are used to compute the rati o 


£l’ £ 2 *’**^ £i+3 ^ ^i+3 
£i+3^ ^i+3 


is the message sequence) 


is the message sequence} 


which we shall denote by E^(j) . 

The sequential detection test is then carried out as follows 

If ^ A. the receiver declares = 0 

1 ^ 

If RjCj) < A "the receiver declares x. = 1 

i ^ .-M 1 

and if neither holds, the ratio E^Cj + 1) is evaluated 

using an additional received symbol r. . and the SDT 

- 1 + 0+1 

applied to it and so on. The thresholds A^ are predeter- 
mined and will be shown to be related to the bit error 

probability of the receiver. Setting - 1 ensures 

+h 

termination of the SDT at the (itN^) node level in the 
event that a decision doss not materialize earlier. 


Like any other sequential detector, this detector is 
characterized by an ASH and by an input and output buffer 
requirement arising from the variable decoding delay involved. 
We deal with each of these topics separately in the sections 
to follow. 
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Fig. 4.1. Implementation of the Sequential Detector 
Employing a ML Criterion. 

The sequential detector may he implemented as shown 
in the block diagram of Fig. (4.1), The inpu t .and output 
bqfjtejrs are needed on account of the varying decoding delay . 
The formant storage sec tion stores the metrics of the 
survivors at the (i+l)"^^ node level needed to begin the 
detection of the next symbol whilst the bit is being 

detected. The acti ve sto rage sect ion stores the metrics of 
the survivors at whatever node level the detector happens 
to be at during the detection of the present symbol x^ , 

The i message symbol of each of the survivors is also 
stored here. The sequential testing block uses the metrics 
of the survivors at the current node level in order to 
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determine whether a decision can he taken or not. 

With this, OTor description of the sequential detec- 
tion algoritlim and its implementation is complete and we 
now go on to obtain an upper bound to the bit error proba- 
bility of the sequential detector. 

4.3 Bound on Bit Error Probability 

4 ,3 ,1 The method employed to evaluate a bound on the bit 
error probability of the sequential detector is basically 
an extension of the generating function technique introduced 
by Viterbi to general FSM*s (ref. Viterbi CviT -71 1>. 

The technique basically consists of ennumerating exhausti- 
vely, all possible pairs of output sequences of the FSM, 
Associated \d.th every ordered pair of output sequences, 
there is the probability that the 1st is the true output 
sequence and the second is the estimated output given that 
the 1st is the true output sequence . Wow clearly^ the sum 
of the probabilities associated with every ordered pair of 
output sequences in which the two sequences comprising a 
pair differ in their i^^ symbolswill constitute a union 
bound on the probability of bit error of the sequential 
detector* 

For the particular case of convolutional codes, a 
simplification is possible since convolutional codes are 

Ij. r. 



group codes and hence the error prohability is the same 
for every possible output sequence of the convolutional . 
encoder* It is thus for this reason that the bound on 
error probability is evaluated considering the all zero 
sequence to be the true transmitted sequence, 

To facilitate understanding of our derivation of an 
upper bound on the bit error probability of the sequential 
detector we now introduce some terminology. 


4.3.2 

The definitions to follow relate to the information 


transmission system considered in Chapter I and the block 



Fig. 4,2 Information Transmission System Model. 


Ve will denote the t 

estimated message sequence by 
estimated state sequence ly 


C Xg j • * • • 

0 ^ A ■ ' 

- 2 * 


.) 

) 
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estimated output of the 5SM to he the sequence 

t ^ ^ 

^ * * • • ^ 

and the estimate transmitted sequence by ( ^ 

We define j- 

the sequence C ( / ) , ( 3 

to he the compared message sequence 

( |^)*»**3 

Bi £2 

to he the compared state sequence 

C(^^> . ( 5 3 

2i I 2 

to he the compared output sequence 
of the FSM 

C (y^- y^), (Vg - to he the 

error transmitted sequence or simply^ 
the error sequence. 


X^to he the 1st i« length sequent C^l> 
message sequence, 


^ to he the number of states of tie FSM, 

the veight function associated with a compared message 

Xj Sj 

sequence symbol C *^^3 Qhd a compared state []] 7 ^^ 3 to he 

1 2 ^ ^4 

the function where *w* is the Euclidean ^ weight 

of the corresponding error VGctolL [] y^3 j 
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w 




and the symbol *D* Is an indeterminate, 

^be •weight function associated with a com.'parec 
seauenoe to he the product of the weight functions associated 
with the individual comp arai message sequence and state 
sequence symbols. The weight function of the sequence 

Xn X ; 

^ ^ A )} ^ /C ) ^ enables us to evaluate the proba- 

X- X, 


^ / ■‘■•2 

V 

bility that the sequence x^, x^,... was transmitted but 
was estimated as the sequence Xg, 


• • • * 


The compared state and compared trellis 




in which each vertex corresponds to a compared state ^^*3 
and each transition between two vertices is accompanied 


by the weight function associated with the transition. 


nu ll sta te to be a state in either the compared 
state of the compared trellis diagram in which ( z 

S~ to be the number of states in the compared state 
2 

diagram. = Np in general, 

A merging sequence to be a compared message sequence 
in the compared trellis diagram which begins and ends on a 
null state without passing through an intermediate null state. 

A branching sequence to he a compared message sequence 
in the compared trellis diagram which begins on a null state 
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and -which thereafter does not pass throijgh a nifLl state. 

The weight fur).ction of a nod^e in the compared 
trellis diagram to be the sm of the weight functions of 
all sequences leading to it which have branched off from 
the true message sequence at an earlier node level. 

The vector ”1 to be a vector ha-ving 

J W Q 

components whose elements are the weight functions of the 
nodes at the j node level of the compared trellis 
diagram. The 1st Nj, elements of G ^ give the 

weight functions of the null states at the node level, 
and finally j the weight f-unctlon mat rix: 3 to be a 

(1I_ X N-) square matrix whose (l,n) element gives the 

C V 

weight function of the transition from the 1^^^ node at a 
node level in the compared trellis diagram to the m^^ node 
at the very next node level. Clearly, we have 

1= CwI3gi3 ...(4.1) 

3+1 

To illustrate the above, we consider an example of 
a FSM and present the corresponding trellis and state 
diagrams. The FSM is the one considered earlier as a 
model for a channel with intersymbol interference, (see 
Fig. 4.3). ¥e note here that for the particular case of 
inter symbol interference, the null states of the compared 
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Fig. 4-. 3b Compared State Digram Shotring Input and Output 
• In each Transition. 


(l)^ode level 




(i+l)^^ode level 
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state diagram are eqToivalent arid can be replaced by a 
single state if state minimization is desired. This is 
because the FSM is linear i.e., the equations d and w are 
linear equations. However, since this is not time of 
general FSM*s,we do not attempt to simpli:^ the compared 
state diagram here. 


4 .3 * 3 « 


Having completed the necessary preliminaries, we 
now proceed to derive the bound on the error p robability 
of the sequential detector. Consider the detection of the 
symbol in which the detector recursively evaluates the 
ratio 


p( rq^rg, " message sequence) 


= message sequence) 
f or 3 — 1,2,*.. 

in succession. If the true message sequence remains a 
survivor^ then an error can only take place if a message 
sequence having a symbol other than as its i^^ symbol 

has at the node level of the trellis diagram, a 

metric exceeding that of the true message sequence ty a 
factor InA^ . If the actual message sequence fails to 
remain a survivor, then also an error may result. 



From this we conclude that an error in detecting 
the symbol can occur only if at least one of the events 
listed below talces place* Though ve do not mention so in 
each case, the sequences considered in each of these three 
events are those which differ in their i"^^ symbol from the 
symbol 

A merging sequence branching out from a node level 
1 (1 < i) and merging at node level ii with the actual 
message sequence (i < m < i + has a metric exceeding 
that of the latter at the node level, 

A compared message sequence corresponding to such 
a sequence is shown labelled El in Fig* 4,3, which shows 
the error trellis diagram for the FSM considered in 
Section 4,3.2, We note that such a merging sequence 
would cause an error in the Viterbi decoder also and 
indeed, in the ideal ML decoder having an infinite decoding 
delayjthis event is solely responsible for error in 
decision making. 

Event 2 * 

A branching sequence branching out from a node level 
1(1 i) has at the (i + Nij) node level a metric exceeding 
that of the true message sequence, 
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If Zgj • ••» If transmitted sequence correspon- 
ding to the sequence vre ha^;© that the prohahllity 

of the event is given by : 


Pr 


■ S ( I.-lj (l.- J ) 

3=1 -3 3 -3 3 


e 


e 


20n2 


2 (r.- V.) (r.-v.) 
3 = 1-0 -0 '“ 1-3 


= erfc 


d 2au 
— + — InA 

1 - 


• .( 4 . 3 ) 


where <7^=^ variance of the additive Gaussian 


white noise introduced by the channel. 



Pig, Compared Trellis Showir^ Sequences Causing 

Error Events, 
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and where d is the Euclidean weight of the sequence 
( jgt • ^ is hence given by s- 

— i T ^ «*l/2 

d = r 2 y^) yj.)3 ...(4,#.) 

3=1 

By invoking the union bound, one may upper bomd 
the probability of error in decoding the symbol by 
summing the corresponding probabilities for every iressage 
sequence of the type listed in events 1 to 3 above. 

However, since corresponding to each such message sequence 
and an actual message sequence we have a compared message 
sequence whose weight function is known, we sum instead 
the weight functions of the corresponding compared message 
sequences. It might appear from a consideration of events 
1 to 3 that one might have to consider an infinite mrnber 
of sequences but^in practice this is not so since branching 
or merging sequences which branch away from node levels 
from the node level are at great distances from the 
actual message sequence and hence the corresponding probabi- 
lities negligible, We therefore confine our attention to 

those sequences branching off at or after the (i- 

we th ^ 

node level wherq^define the (i- Ng) node level to be a 

node level sufficiently ^far* in the above sense of the word 
Ish 

from the i node level. The summation of the weight 
functions mentioned above can now be carried out as follows;'* 
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1jh 

starting at the (iw*Ng) node level of the compared 
trellis diagram, -we assign a veight fwiction of 1 to the 
nioll states and 0 to the others. We then arrive at the 
■weight fimctlons of the nodes at the i"^^ node level 
successive multiplication of the weight function vector 
*^i-N ^ weight function matrix £w 3 as helows- 


^i-Ng+i ^ *^i-Ng +3-1 ^ 

3 = 1,2,. . Ng ..(4.5) 

'f'Vi 

At the i “ node level, -we modify the weight function matrix 

¥ to exclude those segments corresponding to message symbols 

identical to x^^ and obtain 31 through multiplication 

as before. To arrive at the -weight functions of the nodes 

at the succeeding node levels^-we modify the weight function 

Cwll and replace by 0 the weight functions of the segments 

branching out from the null states since we are not 

interested in considering sequences branching off the true 

th 

message sequence path at node levels beyond the i node 
level as the event that they represent constitutes a sub 
event of an event already considered in 1, 

As an example, consider a sequence that branches off 
at the i-3 node level but which passes through a null 
state at the (i+k)^^ node level. Then consider the event 
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that the sequence has at the node level (i+k+1) a metric 
exceeding hy In Aj_ that of the true message sequence. 
Clearly, this can happen if and only if the merging sequence 
obtained by considering the section of this sequence in 
bet-ween the (i-*j)^ and (i+fc) node levejshas a metric 
exceeding that of the true message sequence since otherwise 
this sequence would not remain a survivor at the (i+k)^^ 
node level. Hence our statement earlier on to the effect 
that this event was a subevent of an event whose contribur* 
tion to the union bound on the probability of error had 
already been considered. 

As the last step^we proceed to recursively evaluate 
for 3 = 2,3, .... by multiplying this time by the 

modified weight function matrix. Having done this, it is «. 
simple matter to bound the error probability as i- 

H^-1 Nq 

PE < S S G. (j) 

1=^1 3=Np+l f 


D = erfo 


i/d 

i- 



+ 2 G„ (3) 

3= Np+l 


+ 



2 

i=l 


2 G. (3) 
3=1 ^ 


d 

D 


= erf c 




erfc 
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...(4,6) 



The last two terms constitute a hound on the prohihilitjr 
of hit error of the Viterhi algorithm detector though its 
derivation is slightly different from that hy Viterhi in 
CviT - 713, By making the A^*s sufficiently large we 
can make the additional term small thereby consolidating 
the statement made earlier that the error performance of 
the sequential detector is comp arable to that of the 
Viterhi algorithm detector, 

4,4 The ASN and the Buffer Requirement of the Sequential 
Detector . 

4.4.1 Bound on the ASNsirfo will first proceed to derive in 

this Section, an upper hound to the ASH of the sequential 

detector, l/Je revrrite the expression for the Average Sample 

Number given in Eqn. (2.1) as follows 

N^ + 1 

ASN = 2 3- P(d) ...(4.7) 

3=1 

whe^® pC3) here denotes the probability that the SDT terminates 
the detection process of the symbol at the (i + 3)^^ node 
level of the trellis after observing the 3^^ future symbol 

i^i+3-1’ 

The derivation of the bound on the ASN closely 
follows the derivation of the bound on the bit error probar- 
bility of the sequential detector. To begin with ‘ we seek 
an upper bound on the probability that the test for the 
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message symbol does not terminate at the (i+j node 

level given that Aj^. = ^ ¥ k s.t, <0 ^ k < 3 ). 

We shall denote the probability of this event by q(3). 

We draw a parallel between this event and the event repre- 
senting a decision error at the (i + 3 )"^^ node level. The 

latter event is an event of the type Event 3 listed in 
Section 4,3, An upper bo\md for the event was obtained 
in Section 4,3 by utilizing the miion bouad and summing 
the probabilities of every branching sequence of the tTpe 
listed in Event 3 having a metric exceeding that of the 
true message sequence by an amount equal to In . 
Similarly, we can obtain an upper bound on the probability 
of non termination of the sequential test at the 1 + 3 ^^ 
node level by summing the probabilities of every message 
sequence of the type considered in Event 3 having a 
metric exceeding that of the true message sequence by an 
amount equal to In , Hence we can upper bound q{3) 

3 

as follows t— 


N 


1(35 2 

k = Njifl ^+3 


N. 


D = erfc 


‘/d 


F 
k=l 


5 = erfc 
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(4.f) 



Since the probability of nonr- termination at 
the ( 1 + 3 )'*'^ node level \d.ll deerease if one uses insteadj 
a finite set of values for ¥ 3 ^ 0 ^ k < 3 we can write i- 


1-2 p(k)<q( 3 ) 

k=l 

Simming over all j, 1 < j ^ on both sides, we obtains* 


N„ 


Nn 


: ^ t ^ 

% - 2 2 p(k) ^ 2 q( 3 ) 


i=i k==l 


3=1 




Adding one to both sides and noting that 2 p(k) == 1 , 

k=l 

we write, 

VI . 

(N+ 1 ) . (2 p(k)) - 2 2 p(k) < 2 q( 3 ) +1 

1 k=l 3=1 k=l 3=1 


VI 


N„ 


. . 2 p(k) . k < 1 + 2 q( 3 ) 

k=l 3=1 

Nm N 
T c 

i.e. ASN 1 + 2 2 G. ^(k) 

3=1 k=N^+l 3-+3 


Uj Nj, 


D = erfo 


^ aTd 


+ 2 -2 0, (k) 

3=1 k=l 1 +3 


0 *^= erfc 


■vTd 


... (4.9) 
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Equation (4,9) gives the desired bound on the 
ASN* Me note that the last term on the RBS of sqn. (4.9) 
can be neglected since it will be small compared to the 
first two terms, 

4.4«2. Optimal Threshold Setting 

It should be clear from equations (4.6) and (4.9) 
that, whereas the bit error probability of the sequential 
detector can be made arbitrarily close to that of the 
Viterbi detector by choosing suitably high thresholds 
¥ k 0 ^ k < N , we will by so doing, increase the 
value of the ASN undesirably. Also for the same value of 
additional probability of error introduced by the -sequential 
detector to that of the fixed decoding delay decoder, there 
exist an infinite number of threshold settings and hence 
we seek in this section to find that optimum setting 
minimizing the ASN, For this we need to solve the equations- 




dA 


3 


/"\PEg + 


ASN 


= 0 


¥ 3 "■ 1,2, N^ 

...(4.10) 


where PEg corresponds to the additional probability of 
error term introduced in the bound on bit error probabilii^ 
in equation (4.6) by the sequential detector i.e., 
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and to find the solution corresponding to a minimum of the 
ASN* This ve do in Appendix 1 and the optimum thresholds 
turn out to he given hy 

Aj = A ^ 1 = 1 , 2 ,..., . 

which is a very convenient result to have obtained from 
the practical point of view. The value of A oan of course 
be determined from the constraint on PEg . 

4 ,4 .3 Buffer Requirement 

The buffer requirement which stems from the 
fact that decisions are being made with variable decoding 
delay need only be as large as is necessary to mabe the_ 
probabilily of buffer overflow small compared to the bit 
error probabililsr , 

Now a large number of successive terminations 
at the later node levels will clearly cause a buffer over- 
flow, Corresponding to each node level jjK i < i+N^+l_ 
we can define a buffer requirement corresponding to the 



possibility of successive terminations at this node level 
as f llows . Let pCj) represent the probability of test 
termination at the node level. Then assuming 

independent termination of the sequential detection test 
for successive nessage symbols, we obtain that the probar* 
bility of u successive terminations at the (i+j node 

f- 

level is given by Lp(j)J . We are interested in u 
such that 

E P ^ PE .,.(4.12) 


then the corresponding buffer requirement is given by 


+ 1 + i - u 




2i 


R 


n. q bits for the input buffer 


and . u( ^ - 1 ) bits for the oui^ut buffer where 


n is the number of elements in the vector r^ 
q is the number of bits into which each element of r^^ is 

quantiz ed 

and R is the ratio nj/n of decoder cloclc rate to the 
input data rate. Clearly we need R' ASH* 

Having obtained thus the corresponding buffer 
requirements for all we now consider the largest of 
these to be the required buffer memory since this would 
correspond to catering to the worst possible event. 
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Because at node level y tile test Is forcibly 

terminated, it is expected that successive terminations 
at this node level -will usually cause the greatest buffer 
requirement. 

4.5o Results and Conclusions. 

The bounds an the bit error probability and 
ASN of the sequential detector as well as the expression 
for the buffer memory derived in Section 4.4.3 have been 
evaluated for the case of rate V2 convolutional codes 
having constraint length K varying from, 3 to 7 using the 
computer programme detailed in Appendix 2, The codes 
chosen were those which had the maximum value of the 
minimum free distance amongst codes of the same constraint 
length K. The generator polynomials of these codes 
(see LlAR - 73 3) are given below 


TABLE 5 .1 


K 

Generator Polynomials 

K = 3 

G^Cd) = 1 D 

GgCD) = 1 ® 

If 

g^Cb) = 1 ® D ® 

GgCD) == 1@D®D^.®D^ 

K = 5 

G^(D) = 1 €) . 

G^(D) = 1® D 
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(D) = 1 Q D S) D^- 
G^ (D)=10d2@D^@D^©D^ 

G^ (D) = 1 © © D © D @ D^ 

GgCD) = 1 0D@D^ ©D^ 


In addition to the evaluation of * these hotmdsj 
siduLation. results have also been obtained (using the 
computer program in Appendix 3) and the results presented 
in Fig. (5.1) to (5.6) . 


In Fig. (5.1) we show the variation of the PE 
with threshold setting for two values of the SNR obtained 
through simulation and . evaluation of the bound. We 

see for moderate values of SM the bound on PE to be 
fairly tight. 

In Fig. (5.2) we show the variation of the ASH 

with the SHE for the case when the thresholds are set so 

as to make PE- = PE l.e. for the case when the 

^ Viterba. 

bit error probabilily of the sequential detector is twice 
that of the Viterbi algorithm detector, ¥e note firstly 
that the ASH is virtually independent of the SHR as seen 
from the simulation results and secondly that the ASH bound 
becomes tighter with increasing SNR. 
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In Fig. ( 5 . 3)5 we plot the variation of the 
A.SN with the value of the constraint length K of the 
convolutional code using tofk she theoretical hound '«,« well 
fre yesalt obtained through simulation. Uhereas the ASN 
is seen to monotonioally decrease with K through the 
simulation results) the bound shows increasing K to have 

the same effect as an increase in the SNR namely) the bound 
becomes more tight for large values of the SNR, 

In Fig. (5.4), we plot the variation of the ASN 
with the SNR) for the case when decision feedback is 
employed in this receiver using theoretical results in 
which we assume past decisions to be correct as well as 
simulation results. We see from this that there is no 
significant loss in performance arising out of decision 
feedback. The reason for this is that though decision 
feedback does result in error propagation (see below), and 
hence in an increase in the error probability, this is 
counter balanced by a decrease in ASN arising out of decision 
feedback. 

In Fig, (5.5), we present the average number of 
additional errors caused by incorrect decision feedback for 
various values of idle SNR with the threshold set so as to 
make the bit error probability comparable to that of the 
Viterbi detector. As expected, the number of successive 
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errors diminished vith increase in the SNR, 


In Fig. (5,6), -we present the variation of the 

ASN with the ratio / PE ' ) where PE 

^ Viterhi Viterbi 

denotes the bit error probability of the Viterbi detector. 

We observe from this 'tdiat by adjusting the threshold A, 

we can obtain a wide range of performances from the 

sequential detector. 

In Fig. (5.7), we present the variation of the 
maximum number of successive terminations at the (Nl^ + 1)"^^ 
node level for different SNR*s and we see that the result 
is not different from the approximation in Section 4 .4.3 
and that the number of successive terminations does not 
vary widely with the SNR, 

In Table 5.^ we compare the storage requireme* 
nts of the sequential detector Ad.th that of the sequential 
detector. In this we include the input and output buffer 
requirements of the sequential detector, though we do not 
consider for either the survivor metric storage since it 
is common to both. The storage requirement of the sequen- 
tial of the sequential detector is given "ty s- 

(K-l) Nm I- ^ ' •* 

2 + L.Nj+1 + — (ur-1) - u J .n,q + u( g 1 ) bits 

H 

where the symbols have the meaning given to them in Sec .4 . ,3 
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and the 1st term represents the survivor symbol storage 
of the sequential detector* ¥e take = 4K, n = 2 
(corresponding to a rate 1/2 pods ), q = 3 (corresponding 
to 3 level quantization), u = 3 (as obtained from simulation 
results) and R = ASN (corresponding to the smallest value 
of R -which represents the worst possible case). We also 
present i . estimated values of the storage requineiaant of 
the sequential detector for the case K = 8^ 12 .From the 
table we see that for large values of K a tremendous saving 
in the storage requirement will result. 

Prom these results we conclude that whereas the 
sequential detector does result in a considerable sa-vLng 
in the storage requirement, whether or not it can be applied 
in a particular situation will depend upon the nature of 
the situation i.e. upon whether a loss in decoding speed 
can be tolerated or not. 


Table 5,2 

STORAGE RBQUIREMMT 


K 

Sequential 

De-fcector 

Viterbi Detector 

3 

172 bits 

48 bits 

5 

220 ’• 

320 » 

3 

812 " 

4096 « 

: 12 

2342 " 

96 K bits 
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CHAPTER V 


CONCLIBION 

5.1 A Siffiimary of tlie Thesis 

In this the sis j binary sequential detecl^ton 
has been proposed for a class of information transmission 
systems. Associated with every sequential detector is a 
sequential detection test (SDT) which determines when a 
satisfactory decision regarding a particular message symbol 
can be made. Sequential detectors employing two different 
SDTs involving the a posteriori probabilities of the 
hypotheses and and a maximum likelihood criterion 
respectively are considered in this report. 

The sequential detector employing the a 
posteriori probabilities of the hypotheses and is 
shown to have an error performance comparable to that of 
the optimum fixed decoding delay receiver. In addition to 
this, the sequential detector is shown to have a considerably 
reduced computational complexity though it does have a lower 
decoding speed. Though this sequential detector is believed 
to have a superior error performance when coapared to the 
sequential detector employing the ML criterion, the former 
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is difficult to implement as it needs exponentiators in It 
implementation and it is for this reason that we consider 
the latter. 

The sequential detector employing the ML 
criterion is shown to have an error performance comparahie 
to that of the Vlterhi decoder without requiring “ttie large 
storage requirement of the latter. However, this sequenr* 
tial detector also suffers from a loss in decoding speed 
and hence its applicability in any situation will depend 
upon the nature of the particular situation. TJ^per bounds 
on the bit error performance as well as the average 
decoding delay have been obtained using an extension of 
Vlterbi»s generating function technique. These bounds 
have been evaluated for the particular case of a few 
convolutional codes. Finally, simulation results giving 
information as to the tightness of these bounds as well as 
shedding light on some important features of sequential 
detection are presented for the very same convolutional codes 

6,2 An Assessment of the two Sequential Detection Algorithms 
and Suggestions for Future ¥orfc. 

Before an assessment of the sequential detectors 

presented in ChaptersIII and IV is made, a couple of remarks 
are made in connection with the applicability and advantages 
of applying sequential detection to communication systems. 



Firstly^ it should be noted that vhat really makes sequential 
detection applicable to the ITS model considered in 
Section 2.3 Is the presence of the FSM in the model since 
this causes the received information r gardlng any particular 
message symbol to be spread over several symbols. Secondly, 
ve -would like -fco clarify the role played by sequential 
detection in reducing the hardware complexity of the fixed 
decoding delay receiver and the Viterbi detector. The 
reduction in hardware complexity is entirely due to the 
substitution of a serial implementation of the fixed decoding 
delay algorithir'^ in place of the existing parallel implemen- 
tation and has nothing whatever to do with sequential 
detection. Sequential detection serves the single purpose 
of improving the decoding speed of the receiver employing 
the serial implementation. Frcan this it can probably be 
generalized that, if simplification of a receiver structure 
is described in the future, -fche first step would consist of 
discovering a serial implementation of the algorithm. It is 
only then that sequential detection can possibly be applied 
to improve* upon the decoding speed of -the modified receiver 
struc-ture* 

With -this, we will now go on to make an assesament 
of the sequential detectors employing the SPBI and -the 
maximum likelihood (ML) criterion. The first point to be 
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noted in connection with the sequential detector employing 
the SPRT is the need for exponentiators in its implementa- 
tion. If one goes beyond the exponentiators and considers 
the relative performance of the sequential detector and 
the optimum fixed decoding delay receiverj one finds that 
a considerable saving in the number of computational 
elements needed can be achieved by the application of 
sequential detection. The amount of saving can be computed 
from a knowledge of the parameters L and D of the sequential 
detector (see Section 3.6). Hox-fever, for a meaningful 
assessment of the performance of the sequential detector, 
it is necessary to sp'oify the ASR and the bit error proba- 
bility of the detector in conjunction with each other since 
it is possible to trade off between the two by suitably 
adjusting the value of the threshold A. For this we need 
to know through some means, the value or at least an 
approximation to the value of the ASR for different values 
of the threshold A. Hence there is need for a more detailed 
analysis of this detector both in the way of determining the 
dependence of the ASR upon the threshold A as well as la 
determining the performance and saving in computational 
elements of the detector for specific situations of practical 
interest and future work in this area could be directed 
towards this topic. 



IffeVrtov move oji- to an asfesgment of the sequerh* 
tial detector employing the ML criterion* Unlike in the 
case of the sequential detector considered above, this 
detector can "be implemented without much difficulty in 
practice. However, for any meaningful assessment of the 
performance of the sequential detector one must consider 
the average sample number in conjunction with the hit error 
prohabillty of the detector 3tlst as in the case of the 
sequential detector employing the SPRE. Such an assessment 
can he made for any specific US as hounds on the ASN and 
hit error prohahiliigr are available » 

These hounds have been evaluated for the specific 
case of several convolutional codes and both theoretical as 
well as simulation bounds are presented in Fig. (5,1 ) to 
)• From these results the following conclusions can 
be drawn *- 

1, The theoretical bound obtained for the bit error probar» 
bility is tight for moderate to large values of to SM. 
The same is not true in the case of the ASH and ijie bound 
is conservative even for high values of the SKR. 

2. The value of the ASN for the case when the bit error 
probability is comparable to that of the Viterbi detector 
is roughly given by half the constraint length. This can 
only be a rough guideline since strictly speaking, it 
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is the minimum free distance of the code and the 
number of code sequences having the minimum free 
distance as well as distances slightly greater than 
the minimum free distance which effect the value 
of the ASN rather than the value of the constraint 
leng-Ui K. 

3. Decision feedback does not result in any serious 
loss in performance and can therefore be gainfully 
employed to dispense with the need for the dormant 
storage section (see Fig. (4.1)). 

4. The buffer requirement of the sequential detector 
is not very much greater than that determined in 
Section 4v4' ,3 under the assumption of jhidependant ■ ’ 
termination of the SDT at any node level of the 
trellis for successive message symbols. 

All these observations hold good only for the 
case of the example of convolutional codes and it is not 
possible to generalize just on the basis of these results* 
Hence, evaluation of these bomds for the case of i,s*i* or 
any other practical example of such an ITS would be of 
interest and future work could be directed towards this 
area. 

Hence we see that whereas the saving in compu** 
tational conqplexity offered by both sequential detectors 
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is indisputable, the performance of the sequential detector 
in terms of the ASH and bit error probability have to be 
determined afresh for any particular US for one to be able 
to make a decision as to viie-ther or not to employ 
sequential detection. 

Finally . an interesting ai'ea towards which 
future work could he directed is the consideration of other 
sequexitial detection tests for the sequential detector. 
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APPMDIX I 


From equation (4,10) m sea that In order 
to determine the optimum threshold setting ve need to solve the 
set of equations : 



¥3=1,2,..,,!^ (Al,l) 

where F = ASN +KPE_, EMsing 
the Lagrange multiplier. 


However wo do not have with us an expression 
for the function F in terms of the threshold A^ and 
hence we substitute for the ASN and PSg, the bounds 
obtained in equations (4,6) and (4*9) which will amount 
to the same thing if the bounds are tight. 

For the sake of convenience, we reproduce 
here below the bounds referred to above i 
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Hence we can rewrite equation (A,'l,l) using equations 
(A*1*2) and (A.l#3) as fol^lal^^s t 
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Now, 2 G. ,(k) is clearly polynomial in D and therefore 
< k=NF+l ^ J A 


we can write : 
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polynomial in D, 


Equation (A. 1*4) can 1-3 written now as : 
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Hence the solution = ^ , 3 = 1,2|...., % corresponds 

to a minimum of the function F« 
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APPENDIX 2 


PROGRAIME TO EVALUATE THE BOUNDS ON ASH AND PE OF THE 
SEQUENTIAL DETECTOR EMPLOYING THE ML CRITERION. 

In this section of the report, we consider 
a programme written to evaluate the bounds obtained in 
Chapter lY on the ASN and the average bit error probabi- 
lity of the sequential detector employing the ML criterion, 
when used for the detection of oonvolutionally encoded 
data received over ASffGN channels. The programme has been 
written to evaluate the bounds for rate 1/2 convolutional 
codes of any constraint length. Evaluation of these bounds 
is carried out by using an extension of the generating 
function technique introduced by Yiterbi **71 [J. The 

proceedure that will be followed has already been outlined 
in Section 4,3 and we only point out here a few simplifica- 
tions as well as a modification in this proceedtLPe, The 
modification arises because we are in a position to tighten 
the bit error probability bound with the foreknowledge that 
the optimal threshold setting envisages uniform thresholds 

because we are dealing with the particular case of convolur 


, The simplifications arise only 
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tional codes. 



The first simplification arises since conyolti- 
tional codes are group codes and hence the hit error 
probability is the same for every transmitted sequence. 
Clearly it is no longer necessary to average the bit 
error probability over the ensemble of all possible trans-' 
mitted sequences. Hence in determining the bound on the 
bit error probability, wa deal -with the state and trellis 
diagrams instead of the error state and error trellis 
diagrams respectively. We consider arbitrarily the all 
zero sequence to be the true message sequence throughout 
the remainder of this section. 

We will now consider how the bound on the 
probability of error (bit error) may be tightened given that 
the thresholds 3 su'e equal. Consider a 

branching message sequence which branches off at a node 
level at or prior to the i node level and is such that 
at some nodt level i+j where 1^3;^!^ » it has a metric 
exceeding that of the true message sequence by an amount 
equal to InA^. Also, let the seq'uence be such that the 
output of the FSM corresponding to its (i+3-^)^^ symbol is 
a s-tream of zeroes. Then clearly, the sequence obtained 
by truncating the last message symbol of the sequence will 
also have a metric exceeding that of the 1st (i+3-l) symbols 
of the true message sequence by an amount equal to In A^, 
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HenoG when we sum the probability of these two events 
(whioh entirely coincide ) in order to obtain the union bound, 
we are indilLging in some double counting which we would like 
to avoid. This we can do very simply by ignoring one or 
the other of the two sequences in such oases and in the 
program the longer seqioence is ignored* 

The next modification we consider here has the 
advantage of decreasing computation time on the computer. 

In order to obtain the weight function vector 
the weight function vector , we will need to perform 

the matrix multiplications Indicated in equation 4*1 which 
we reproduce below : 

The number of cor[ 5 )onents of the vector 3 " ^ 
for the case of the convolutional encoder since we are 
dealing with the trellis and not the error trellis dis^ram 
for this FSM. Hence in the ordinary way, this matrix multi- 
plication would involve multiplications. However, a 
close inspection of the weight function matrix[i(l for the 
case of rate 1/2 convolutional codes reveals that since any 
node at , a. given node level can be reached i^om only two 
nodes at the previous node level, there are only two non-zero 
terras in each row of the matrix* To illustrate this, the 
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trellis and weight function matrix for the rate 1/2, 

K = 3 convolutional code considered earlier in Chapter lY 
is shown in Figs. (A. 2. la) and CA,2.1b), Bence, a 
reduction in the number of multiplications from to 

jp 

2. Nj. can be achieved if we could determine for every 

node level 3 at the (i+l)"^^ node level, the two nodes 

th 

leading to it from the i node level. To do this, we 

will need to number the nodes insca-.'W fashion. The state 

of the encoder is determined by the past (K~l) inputs 

received by it. Let the state be represented therefore 

by a binary nirnbor with the latest input forming the least 

significant bit. Now, consider the decimal number obtained 

by adding 1 to the above binary number and let the nodes 

of the trellis diagram which are nothing but states of the 

FSM encoder, bo numbered by their oorresponding decimal 

numbers. Then v/e see that in the trellis diagram the nodes 

3 and 3+ % ■ lead to the nodes ( 23 - 1 ), 23 for all 3» 

2 

^ 3 ^ • This suggests that we divide the nodes at 

two ad3aoent node levels into setSof 4 nodes as in Fig. 
(4,C) . In the 3th such sot of 4 nodes, ym will. refer to 
the nodes whose numbers are 3j 3"^ >23 -1, 23 as_the 

nodes NA(3) , KB(3), NC(3) and ^ NL (3) respectively. 

As shown in Fig, (A, 2.1c), associated with every such set 
of 4 nodes, we have 4 weight functions L AG(3), L AD(3)> 



IJBCCj) and I£D(j). It is cl^ar that iii orisr to carry out 
the matrix multiplication of eqn* 2^11 usin.'^ 2 , N 
multipliers, we only need to know the weight functions 
LAG (3). LBG Q) , LAOa) and HBDCj) for each value of 
In tho program, these values for all 3 , 1 ^ Np /2 are 

initially evaluated and stored so that they can he recalled 
for each matrix inultiplica.tion. 


The last simplificotion that is possible arises 
as follov/s. As we have, already mentioned before, the 
probability of error in detecting the symbol x^ being 
caused by a message s;Ki,uence having i^^ symbol = 1 and 
whose corresponding transmitted sequence is at a Eucledean 
distance 2ci from the actuality transmitted sequence is 
given by :~ 


erfe 



CT" 11 InA 
2 /d 


where cr^^is the variance of the noise at the output of 
the channel. 

The Eucledoan distance ^d between the trans- 
mi ttod sequence corresponding to an output sequence having 
a Heimnln;, distance ’p* from the all zero output^ sequence 
and the transmitted sequence corresponding to the all zero 
sequence Itself is given by 
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i.G. 


• « • 0^* s <1^ 


= p, (4h^) 


Hence -fciiG square of the Euclide"^ distances corresponding 

to the various message sequences Cc?n take on only discrete 

values and it is sufficient to know the value of the Hamming 

distfjnoo p corresponding to every such sequence in 

order to evaluate the probability that its metric will 

exceed that of the true message sequence by any specified 

amount. Hence we use as the weight function instead 

,2 

of the function . 

From this, it is evident that the weight 
functions of the various nodes at any nods level are 
polynomials in D. 

In the program therefore, we store the weight 
functions in shift registers, maintaining one shift register 
for each node in which the bit gives the number of 
message sequences leading to that node which are such that 
their output sequences are at a distance *p* from the all zero 
sequence • The proceedure for evaluating a bound on the 
probability of error in d-'tecting the message symbol 
involves recursive evaluation of the weight functions at 
successive node levels. This recursive proceedure now 
clearly Involves multiplication of polynomials in D. Since 
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the coefficients of the polynomials are stored in shift 
registers, cleerly multiplicctions correspond to "shifting” 
of coofficionts within the shift register. Hence, when 
WG wish to obtain the weight functions of the node HC(3) 
at a node Icvcsl from those of tho nodes H 6 .(; 3 ) and ]©(j) 
at the prcvioTJis node level, wc shift the coefficients of 
the polynomials giving the weight functions of the nodes 
mii) and I©(j) by amounts ..qual to LAG ( 3 ) and LBC(3) 
respectively iuid add the resultant polynomials. 

It remains to explain the programme Itself, 

The Flow chart shown in Fig, A. 2 . is easy to follow. 

The 1st stop in the programme in determining the values 

of LAC ( 3 ), 130(3), LAD ( 3 ), LED ( 3 ), for various values 

oi* 3> b 3 Np/2 , Thereafter the recursive process 

involved in obtaining the vreight functions starting from 

the (i~ Ng)^^ to the (i- node level is begun. In 

this programme Ng has bc'-en somewhat arbitrarily chosen 

equal to . In the process three different weight 

functions are used as already explained in Section 4.3, 

The 1st in going from the (i- Ng)^^ node level to the 1 , 

the second in advancing to the (i+ 1 )^^ node level from 

the i'^ node level and the last in advancing from the 

“fc!! 

(i+'l)^^ node level to the (i+ 1^ + 1) node level. After 
each recursive computation, beyond node level i and upto 
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node level (i + )'bliQ sijia of the v§igbt functions of all 
the nodes excepting all zero node at each node level is 
added to the contents of a register MSN which at the 
end of the recursive computation will contain the coeffi~ 
cients of the polynomial used in obtaining the bound on the 
ASN, This corresponds to an evaluation of the 2nd term 
in equation (4,2). The weight functions of the all zero 
node at node levels ranging from the (i+l)"^^ to the (i+N^)'^^ 
node level are added and stored in a register RVIT 
toge tiler with the weight functions of all the nodes at 
the (I+Nq, 4-1)^^ node level. At the end of the recursive 
computation, this register will contain the coefficients 
of the polynomial in D needed to obtain the bound on the 
probability of the practical Yitc-rbi detector. This 
corresponds to evaluation of the last 2 terms in the RBB 
of equation (4.7). 

At the end of each step in the recursive compur* 
tational beyond the i^^ node level and upto the i+1^^^ node 
level, the weight functions corresponding to sequences of 
the type discussed above in regard to a tightening of the 
bound on the bit error probability are subtracted from the 
sum of vreight functions stored in register EASN abd the 
polynomial thus obttdned used to obtain the additional 
probability of bit error PEg introduced by the sequential 
detector. This corresponds to improving upon the bound for 
PEg given in Eqn. (4,11). ' : 
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A.2,1* Flow chart for program eyaluating 
hound on PEq and ASN using 
generating iimction techniCLue, 









APPENDIX 3 


In this section of the report, we present and 
explain a programr^s written to simulate the decoding of 
convolutionrilly encoded data when received ovc?r AWN 
channels using the sequential detector employing the ML 
criterion for its GDI, The programme has been written for 
rate 1/S convolution:.! codes having any constraint length. 
Since convolutional codes arc group codes which have the 
property that the probabilily of error is the same for 
each of tlio trsmsmitted sequences, we have chosen the all 
zero sequencG to be the transmitted sequence in this 
programme. The AV/GN introduced by the channel has been 
siraulatod by generating Gaussian random variates using 
the Box Hullo r technique 

In the following, we present the s teps followed 
in tho programae . for the case when the first future 
symbol corresponding to a message symbol x^ is examined 
followed by those for the case when subsequent future 
symbols E±+2 * •***’ -i+3 ^ examined 

by the do toe tor. It will be seen that scxne of the steps 
followed are common to both cases and^hence the two 
proceedures are treated separately only for the sake of ease 
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In und;.rstrjidinG. Steps Cl to Gil bslow are those followed 

in the C'-=e when th- 1st future symhol has just been 

r.xnrrdncd , 

Cl. ihc of the sui’irivors at the node level 

'•r ■ trr:.nnf-rr.:::d from the dormant storage vhere they 
wore pl-.cccl during the deteobion process involving 
the sy.Tibol to the active storage section. 

C2. A n-'w r^‘c ived .oynhol is generated. 

C3. flKi r.o tries of the segments linking the i^^ to the 
(i+1 nat ' !!nvc l ore computed using the received 
sy::.ho:i . 

C4 . The metrics of the survivors at the (i+l)"*^^ node level 
are dotermined from those of the survivors at the ith 
nodo level using tha above segment metrics and a set 
of add compare select operations. 

C5. The 1^'^^ message symbol of each survivor at the (i+1)^^ 
ncxie level is stored alongside its metric in the 


active storage section, 

C6. The metrics of these survivors are also stored in the 
domont storage section as they will be needed for the 
detection of the symbol 

C7 . The sui’vivor with gr -atest metric amongst survivors 

having i"^^ message symbol == 0 and = 1 are determined. _ 
Using these and the threshold Aj the SDT is carried out 
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CB, If the test results in a decision, the programme 
statistics are updated. These include the latest 
value of the /i5H, the maximum number of consecutive 
terminations at the teriuinating node level as uell 
as the bit error probability of the sequential detector. 
C9. If the test does not result in a decision the sequence 
of stops Dlj .. .. are carried out. 

The following steps D1 to D7 are followed in 
the c-'se when the detection process of the message symbol 
is continued •aid additional received symbol r^^^ 
examined. I < j ^ • 

Dl. The segment rw3 tries linking the survivors at the 

and (i+j+ 1 )^^ node level are determined using the 
received symbol £^ 4 ^. 

D2, The metrics of the survivors at the (i+j+l)"^^ node 
level arc determined using the above segment metrics 
and a set of ACS operations. 

, ■'fell 

D3. T!'.g i”^^ message symbo^ of each survivor at the (i+3+1)^ 

node level is determined from the message symbol of 
the survivor at the (i +3 node level leading to it. 
D4. The metrics of the survivors ^i+ 3+1 

determined ;ind the SKT carried out using these metrics 
and the threshold A. If 3 = a unity threshold is 
used. 
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D5, If the test results in a decision, the program 

statistics referred to in step C8 are updated and the 
next stop follm-fod is D7. 


D6. If tho tost does not ?Gsult in a decision, the above 
steps D1 to D6 arc repeated -with the next received 
symbol and so on 

d 7. If a sufficient number of symbols , i r: 1,2,... 
have been detected to ensiire that the statistics 
computed are reasonably accurate, the programme is 
tv rminatod . Otherwise the detection of the next 
symbol x. _ is begun at step Cl. 

iiip 


Fig. A. 3.1 shows the flow chart for the programme 
in which tho cormnon steps followed in the two cases are 
clearly brought out. 
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Cnrry ou"* ?!Gquentlal fietaction 




— Jpccislan ? 


1 Update results , sufficient 
iteraWons? 

J' Ye 

Stop 


Fig. A.3.1 Flow chart for sinnilation of sequ^tial 
detector using ML criterion for SDI* 
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C t.lRT OF VARiaSLiSSs- 

c KaKli=COwSTHAT)'JT LENGTH OF THE CODE, RATE OF CODFat/WRAT, 
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C MODES=*’0, OF i'iODES IN THE TRELLiSa?** (K-1) 
r taP(T,.T) lsl,2 Jsl,2#..,K GIVES THE GFN. POLfMOMIALS 
c MITERbFii, Of recursive EVALU-ATTOMS of the NT, fn, vector 
C TITaPU'’f'!TiMn VAP, GIVTSC Mq, OF PECHRSIVE COHPUTATIOM 
C G^vFb iHg :’4AJ{, possible OISTAMCE OF A SEOHEMCE 

C AX THE END UP PRESEwT FRCURSIVE COMPHTATTON, 

C AfT.vI) 1*1,2,,, .MODES , Jal ,2,. . ,.T.NTT REFEPS TO THE 
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C B(T.I) l=l ,2, ... .MODES, Jal,2.....LVTT, REFERS TO THE WEIGHT 
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A GdO) .HdO) ,WE(10) ,?IF(lO),RGCtO) .HHIIO ) ,N7.ER(64) ,D (1 00 ) ,C ( 10< 
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PF»Or21 ,tO)KL,’TRAT,NT 
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